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Abstract. Let T denote the transition matrix of an ergodic chain, C, and let 
A ■ I - T. Let E be a perturbation matrix such that T » T - E is also the 
transition matrix of an ergodic chain, C. Let w and u denote the limiting 
probability (row) vectors for C and C. The purpose of this paper is to exhibit 
inequalities bounding the relative error ^ by a very simple function 

of E and A. Furthermore, the inequality will be shown to be the best one which 
is possible. This bound can be significant in the numerical determination of 
the limiting probabilities for an ergodic chain. 

In addition to presenting a sharp bound for explicit 

expression for Hi will be derived in which Cb is given as a function of E, A, u 
and some other related terms. 



THE CONDITION OF A FINITE MARKOV CHAIN AND 


PERTURBATION BOUNDS FOR THE LIMITING PROBABILITIES 

1. Introduction. Let T denote the transition matrix of an ergodlc chain, C, 
and let A • I - T. (The terminology and notation will be that used In [S] and 
[6].) Let E be a perturbation matrix such that T • T - E is also the transition 
matrix of an ergodlc chain, C. Let w and to denote the limiting probability 
(row) vectors for C and C. The purpose of this paper is to exhibit Inequalities 

bounding the relative error ]| ' u) ® very simple function of E and A. 

Furthermore, the inequality will be shown to be the best one which is possible. 
This bound can be significant in the numerical determination of the limiting 
probabilities for an ergodlc chain. 

In addition to presenting a sharp bound for ^ i f ' ^ explicit 

expression for u will be derived in which u is given as a function of E, A, u> 
and some other related terms. 

The approach taken in this paper differs from the traditional methods of 
past authors in that group properties of the matrix A are used to produce the 
desired results where as previous results have relyed upon the so called 
"fundamental matrix" given in [5]. (See [9]) Examples will be given which 
show that the use of the group properties produce superior results to those 
which can be produced using the traditional theories. 



2. Group Properties. The fundamental fact on which the analysis of this papt.r 
Is based Is the following. 


THEOREM. If A • 1 - T where T Is any row stochastic matrix, then A belongs 
to a multiplicative matrix group. 


A proof of this is given in [2] and [6]. It also follows from well known 
results found in [4] and [$]. 

Since A belongs to some multiplicative group, G, A must possess an 
inverse in G. This matrix is called the group inverse of A and is denoted by 
A . The identity in G is P • AA , the projector whose range is R(A) and whose 
nullspace is N(A). 

As is shoTTO in [6] and [2], almost all of the important information 
concerning an ergodic chain is available in terms of the entries of A*^. In 
particular, the limiting matrix, W, for a chain with transition matrix T is 
given by 

(2.1) W - lim « I - AA’'^ (See [6] or [2]) 

n-x» n 

As pointed out in [6], the computation of is not unduly complicated. 
Indeed, computing A^^ is less of a chore than calculating the "fundamental 
matrix." Further properties of A^^ are available in [2]. 




3. A Perturbation Formula for (A + E)^\ Suppose T and T are transition matrices 

m mi mi 

for ergodic chains C and C, respectively, where T - T - E so that A ■ A + E. 

In order to analyze C, it suffices to analyze The purpose of this section 
is to provide an expression for (A + E)^^ which will hold for all possible values 
of E. Notice that E cannot be arbitrary. Since T must be a stochastic matrix, 
the elements, 'ij» ® constrained so that I^^jl i There are, of course, 
other additional restrictions. 

If j ■ [1,1,1,...,!]^, then Aj • 0 and (A + E) j ■ 0 so that Ej ■ 0. If 
w and w denote the limiting probability (row) vectors for C and C, respectively, 
then (2.1) implies that 

E(I - AA^^ - E(ja») - 0 


so that 


(3.1) 


EAA" 


E. 


(i.e.. Row Sp(E) ^ Row Sp(A)) 


Since A belongs to a matrix group, there exist nonsingular matrices P and 

tl^tl 


(3.2) A - P 

1 

O 1 
- -♦ 

p"^ - P 

1 

0 1 

- 

1 

1 

p"\ and I - AA^'* - P 

0 • o“ 

. J. . 


o 

o 


o 

o 


0 ' 1 


(These statements are evident, but the reader may wish to consult [2].. Write E 
In the form 


: 



I 



E 


4 



(3.3) 


E - P 



where Ej^ Is (n - 1) x (n - 1). The fact that EAA 


E Intplles that E^ ■ 0 and 


E^ - 0 so that 


(3.4) 


A - A + E - P 


C + E, I 0 

^ I 


h ' ° 




since C Is again an ergodlc chain, it must be the case that the limiting matrix, 

~ - •• a 

W, must be a rank 1 matrix. By virtue of (2.1), it follows that rank(I - AA) * 1. 

By using the formula 


(3.5) 


“x 1 o" 


1 

o 

1 

Y 1 0 

I* ^ 


1 

1 o 
1 “ ~ 

CM 

1 X 
>* 

J 1 


(found in [2] or [7]) 


it is easy to see from (3.4) that 


I - AA^“^ - P 


I - (C + Ej)(C + E^ 


-E2(C + E^)’ 


# I 


0 
I 

X - 

I 

. 1 
I J 


P-^ 


The fact that rank(I - AA^'^) ■ 1 now implies that I - (C + Ej^)(C + ■ 0. 

That is, C + E^ is a nonsingular matrix. Since C + E^ « (I + E^C ^)C, it follows 
that (I + E^C ^) is nonsingular so that 

,-l ' 


I + EA 




I + E^C ‘ ,0 

-1 ' 
E^C ' ,1 




is also nonsingular and 


(I + E^C’S 


-1 


-E^c'^d + E^C"h 


-1 


P’^ 


(3.6) 


(I + EA^^■^ - P 



Now write the expreeelon for (A + Using (3.4), (3.5), together with the 


fact that (I is nonsingular, yields 


(3.7) 


(A + E)’^ - PI 


C“^(I + E^C“h 


-1 


EjC'^d + E^C"S C"^(I + EjC"^) 


-1 


P“^ 


?ros (i.2) and i3.6) it is easy to see that 


-1 

A (I + EA ) ^ - P 


C“^(I + EjC"b 


-1 


.-1 


(I - AA^^d + Ea'V^ - P 


-E^C'^d + 


-1 




I ! 


J 


and 


(I - AA'Sci + ZA'')~^a\i + EA'^“^ 


-I -1 1 

■E^C + EjC ^) C'\l 


' 0 

1 - 


‘I 


-1 ' 

c ) I 0 


so that (3.7) becomes 



By using the identity (I + EA^) ^ • I - EA^(I + EA^) together with (2.1), 
one arrives at the following result. 


THEOREM 3.1. Let C be an ergodic chain with transition matrix T and 
limiting matrix W and let C be an ergodic chain with transition matrix 
T - T - E. If A - I - T, then 

(A + E)^^ - A^ - + EA^)"^ - W(I + EA^VV(I + EA^)“^ 


It is clear that this theorem guarantees that for the situation under 
question, 

lim (A + E) - A 

so that the following corollary is obtained 


COROLLARY 3.1. For the situation of Theorem 3.1, the elonents of A depend 
continuously on the elements of A. 



This result ca** also be proven using the information in [2] or [3]. 

Now that an explicit representation for (A + is known, one can obtain 
almost all of the important information regarding C through the results of [6]. 
However, the purpose here is to now concentrate on the problem of obtaining a 
perturbation formula and bounds for the limiting probabilities because it is 
these quantities which lie at the heart of any analysis of the chain. 






4. A Perturbation Formula and Perturbation Bounds for the Limiting Probabilities. 

0m 

If W and W are the limiting matrices for ergodic chains C and C, respectively, 
then using Theorem 3.1 together with (2.1) yields an explicit expression for W 
One has the following result. 


THEOREM 4.1. If C and C arc ergodic chains with transition matrices T 
and T - T - E and limiting matrices W and W, respectively, then 

W - W(I + - W - WEA^'^d + EA^V^ 

\diere A ■ I - T. 


In passing, it is pointed out that as a corollary one obtains lim W ■ W, 

E-^0 

which is of course the well known result stating that the limiting probabilities 
are continuous functions of the elements of T. By making use of (3.1) and (2.1) 
another important corollary of Theorem 4.1 is obtained. It is the one which 
reveals the structure necessary in order for the limiting probabilities to 
remain invariant under a perturbation. 


COROLLARY 4.1. For ergodic chains C and C, it is the case that W • W If and 
only if R(E) C R(A). (l.e., the limiting probabilities are unaltered if and 
only if the colusms of E are linear combinations of columns of A.) 


Consider now the problen of bounding the relative error term 


I I u) - a 1 


u 


where u) and S are the limiting probability vectors for C and C, respectively. 
Since every row of W is equal to u> and every row of W is equal to m. Theorem 
4. 1 yields 





(4.1) 


(ti 2 ■ SiEk 


(4.2) 


w - a ■ wEA^d + EA^)"^ 


For the vector 1-norm (|| x jj. ■ ][ |x. |) the Induced matrix norm is 

j . 

[| All, ■ max II xA||, ■ max T |a’. .| because one Is dealing with row vectors 

‘ llx|li-l ‘ 1 J ^ 

and left hand multiplication. A trivial observation is that the relative error 
in u for the 1-norm is always bouiuled by 2. That ls» 


u - m 


^‘•11 “-“111 ‘2 


and ji ui - a |] ^ can be made to be arbitrarily close to 2 with particular choices 
of u and a* However, this does not take into account the relative size of 
II E llj. The expression in (4.1) can provide a more useful bomid in the case of 
the 1-norm. Using (4.1) to bound the relative error in u provides an additional 
desirable feature. Namely, that the bound is obtainable without having to 
impose any additional hypothesis on the magnitude of the elements of E. 

The above remarks are siamtarlzed in the following. 


THE0RE2! 4.2. For ergodlc chains C and C with transition matrices T and 
T " T - E and limiting probability vectors u and ui, the relative error in 
(i) for the 1-norm is 



where A ■ I - T and tCj(C) 


“ - s 111 1 II 111 1 'fr'-} 

llAlljIU'll,. 




Th« I'-noni may not ba the most deelreble choice of nonae. It eeeiae that 
the M-norm la a more natural choice of norm when Inveatlgatlng the aenaltlvlty 
of the limiting probabllltlea to perturbaclona In the tranaltion probabllltlea. 

It la worth emapleting the atatement on norma by noting that for «iy two 
probability vectora, w and w, the following relatione alt^ya hold for an n-atate chain. 


w II j • 1 and II u> - u II ^ 2. 


M - (I) 


^ < II w Ijj i I and II w - u II2 <. /I" . 80 that || J‘|| ” - * 


i 1 11 0) 11 ^ ^ 1 and il w - w !|^ < 1. •«> that 

n 


'• < n. 


Conalder now an arbitrary vector norm end a compatible matrix norm auch 
that il I 11 - 1. Take the norm of both aldea of (4.2) to obtain 


w - (3 


< 11 EA^ II II (I + Ea')"^ II . 


If 11 EA^ II < I, then 


(I + Ea')** II < ;i— 5 — . 

1 - II ea' Il 


and the Inequality takea a familiar form which la given below. 


THEOREM 4.3. Let C and C be crgodic chalna with tranaltion matricea T and 
T» reapectively* where T ■ T - E, Let d ■ u - t3 where <d and <3 are the 
limiting probability vectora for C and C, reapectlvely, and let A ■ I - T. 
If II tli II < I, then 


.ligA-IL, 

^“1 - 



It II E II II II < I, thto 


( 4 .:) 



^•r« K^C) ■ II A li li A^ II . Mar^ov»r» th«re «re nontrivial cM«a whara 
aquallty la actually attained in each of the above. 


Note that (3.1) guarantees that 
h 3 rpothasls. 




which is less than 1» by 


The tara 



is tha ralatlva arror in u while 



is tha ralatlva 


error in A. This inequality is exactly of the saaa fora as tha familiar 
inequality obtained i^an analyzing a perturbed nonsingular linear systra of 
aquations. Tha only difference is tha term k(C). Tha fact that tha analysis 
of any argodic chain revolves about tha limiting probabilities, together with 
tha appearance of <iC) in Theorems 4.2 and 4.3, motivates one to make the 
following definition. 


DEFINITION. Let C be an argodic chain whose transition matrix is T, and 
let A * I - T, The condition of the chain C is defined to be the number 

<(C) . lull u'll- 


Clearly, if Che condition of the chain is relatively small, then the 
limiting probabilities will be relatively insensitive to small changes in Che 
transition probabilities. If the condition of the chain is relatively large. 




11 


Chen Che lialcing probablllcles nay or may noc be senslcive. Alchough (“he 
bound In (4.3) can somecimes be pesslmlsclc, Ic is Imporcanc co poJnc ouc 
chac chare are noncrivlal cases where equallcy is accually attained. Examples 
are given in following sections. 

As a final observation, note that since AA^^ > I - W where W is the 

n^n 

limiting matrix, one has H H ^ ■ 2 - 2mlna)^, ]| AA^^ 1|, ^1, and 

li II, ■ 1 " 2)maxu)^ so that 

<, (C) > 2 - 2minu, > 2 - 
1 ““ ,1 ““ n 

<2<C) i 1. 

< (C) > 1 + (n - 1 . 

2S — ' 1 _ jj 


A special case which is of frequent interest is that in which the 
perturbation affects only a single state. That is, only the probabilities 
for leaving (or entering) the 1-th state are perturbed. The question is 
"how does this effect and perhaps the rest of oi?" 

In this case, the 1-th row of T, denoted by t^, is perturbed so as to 

- - m 

produce t^, the 1-th row of T. If u^ ■ [0,0, . . . ,0, 1 ,0, . . . ,0] is the 1-th unit 
vector, then E is the rank 1 matrix E ■ u(tj^ - t^). Equation (4.1) degenerates 
to 


d ■ u) - u - o)^e^A^\l + EA^**)”^ 


where Since E ■ write 




/T . T..^X-i /, . 

(I + EA ) ■ (I + ) “I ~ ~ a 

i -A % . # If 


I * e^A' 


SO that (4.2) reduces to the following. 





5. Examples. Below, a general example is constructed to show equality In 4.3 
can be attained for the <»-norm as well as the 2-norm. Note that the fact that 
row vectors, rather than column vectors, are Involved means that the ^-matrix 


norm Is given by || A 


max II xA || . ■ max I |a 


Ij'- 


IMI;i J 1 

Consider the regular chain whose transition matrix is the symmetric 
circulant 


" 4n 


3 I 3 i 
13 13 
3 13 1 


3 I 
1 3 

3 1 

1 3 


2nx2n 


Since T is symmetric, the limiting probability vector is 


2n 


[ 1,1 1 ]. 


It is easy to check that A is given by the symmetric circulant 


A^ - - 


n 

-1 

0 

s 

s 

s 

-1 


-1 0 

n -1 
-1 n 

0 -I 


■1 0 

0 -1 

■1 0 

0 -1 


• • • 


• • -1 0-1 

0-10 
-1 0 -1 

-1 0 n 


by verifying that AA^^A ■ A, A*^AA^^ ■ A^, and AA'^ ■ A*^A. (These three conditions 
suffice to define A^. See [2] or [6].) Note that || || ■ 2. 



X . n - I V 
k«l 


2k-l 


I 1. * ^ 


«^ere {v^|l ■ 1,2,. ..,2n) ia the set of the 2n-th roots of unity. (See [l]) 
Since nA is symmetric, || - /maxjX^l and one can see that maxjx^l - 


■ 2n so that 




From (5.1), j| d \ 




2 n(l - 2e) ‘ 


Now II u) II , 


/2K 

2n 


and II E II 2 ■ e ^/in so that 


I d I 


E 1| 


2e 


EA" 


Ell, llA^U JTJ 


<2(0 


0) 


1 - 2e 


1 - 


EA-MI2 1 


- liElMlA^^II 


2 1 - 


imr 


<2(0 



6. Why Not Treat This Strictly as an Eigenvector Problem? 

^ mm mmmmmmrnmmmm m m m m m m m 

In principle » the problem Is an eigenvector problem. That Is, one Is 
analyzing the normalized left hand eigenvector associated with the eigenvalue 
« I for a row stochastic matrix T, or equivalently, the normalized left 
hand eigenvector associated with the eigenvalue ^ A • I • T. The 
knovm facts concerning the eigenvectors of a perturbed matrix are therefore, 
to some extent, relevant. However, there are some peculiar aspects which the 
general eigenvector theory does not capitalize upon. For example, the stochastic 
nature of the problem sets It apart. The fact that the relevant eigenvalue, 

■ 0, (as well as its multiplicity) is unaltered by the perturbation is 
certainly special. The perturbation E Is constrained to be one of a special 
kind, namely one which preserves the ergodlc nature of the chain. 

Moreover, the problem at hand Is not concerned with the sensitivity of the 
entire eigensystem of a stochastic matrix. Only a very special eigenvalue and 
eigenvector with peculiar properties are involved. One should therefore 
not be too surprised to find some sort of special behavior exhibited \diich is 
not present In the general theory. 

In general, if x is an eigenvector for B such that (B - X^I)x « 0 and 
there exists another eigenvalue X^, of B which is close to X^, then one expects 
X to be sensitive to perturbations in B. (See [10]) However, this can 
produce some wrong impressions when applied to the special case at hand. The 
following example illustrates how applying this general theory can be somewhat 
misleading. Let and be two ergodlc chains whose transition matrices are 


given by 


.99995 


.00005 


0 


( 6 . 1 ) 


and 


0 

.99995 

.00005 

00005 

0 

.00005 





.99995 .00005 

.00005 .99995 

The eigenvalues for Aj^ ■ I - are Xj » 0, X 2 .000100002 and X^;^ ,999949998 
while the limiting probability vector is (.4999875, .4999875, .000025). 

The eigenvalues for A 2 ■ I - T 2 are ■ 0 and ^2 * *0001 and the limiting 
probability vector is » (.5, .5). In each case the matrices have another 

eigenvalue very close to the eigenvalue 0. The general perturbed eigenvector 
theory therefore suggests that the eigenvectors associated with the eigenvalue 
0 should be "sensitive" to perturbations in the elements of each of the 
matrices A^^ and A 2 . 

However, if one allows the term sensitive to mean that small relative 
errors in the A matrix can produce large relative errors in the limiting vector 
b), then the sensitivity of the limiting probabilities may or may not be greatly 
Influenced by the distance between the eigenvalue 0 and the other eigenvalues 
of A. 



For the two chains, and of the above example, one finds that 


5000 

-4999.75 

-.25 

-5000.25 

5000 

.25 

4999.5 

-5000.25 

.75 


and 



5000 -5000 

-5000 5000 

90 that < (C, ) y 15*000 while < (C^) * 1* Theorem 4.3 guarantees that the chain 

09 i 'V at £. 

is well conditioned while is more badly conditioned. Indeed, if is 

perturbed so as to produce with ■ T, - E where 

0 
0 
0 

one finds that 

u, (.045452376, .954499897, .000047727) 

1 ^ 

so chat a relative error of 10 in (using the »-norm) produces a relative 

error of about .91 in In contrast, Theorem 4.3 guarantees that a relative 

-3 -3 

error of 10 in A 2 can produce a relative error of at most 1/999 10 in U 2 . 

The conclusion is that one cannot always use the distance between X ■ 0 




and the nearest nonzero eigenvalue of A as a measure of how sensitive the 
limiting probabilities are to perturbations. 


. Why Not Treat This Strictly as a System of Linear Equations? 

If T „ Is the transition matrix of an ergodlc chain. It follows that 
A - I - T has rank n - 1 and any subset of n - 1 columns of A la linearly 
Independent. The problem of finding the limiting probability vector Is simply 
that of solving the system 

uA ■ 0, ■ 1. 

Clearly, this la equivalent to one n x n nonsingular system of the form oM ■ b 

where M Is obtained from A by replacing one column (say the k-th one) by the 

T 

column j ■ [1,1,.. .,l] and b Is the k-th unit vector. 

Since M Is nonsingular and b Is not subject to perturbation, the standard 
result (which Is the analogue of Theorem 4.3) holds. That Is, if a perturbation 
of the transition probabilities causes M to go to M " M F where 
II fII II m'^ II < 1. then 



and |j I [|- 1. (See [10].) This suggests that Cond(M) might also be used as a 
measure of the condition of the chain. 

However, converting the singular matrix A into the nonsingular matrix M 
can drastically alter the condition of the problem. That Is, although A is 
singular, it can be well conditioned in the sense that || A || || A^'^ || Is small 
whereas the modified matrix M is nonsingular but || M || || M ^ || can be very large. 


For example, consider the chain C whose transition matrix Is 



Clearly, A Is positive semldeflnlte so that 

max 

<2(C) - II A|j2j| A II 2 “ — \ where denotes eigenvalue. 

X^ ^ 

It Is easy to verify that the eigenvalues of A are given by 

{ 0 , 1 } so that K-(C) ■ 1 , regardless of what value is 

n-in—in-i n-i z 

assigned to e and what the size of n Is. Now replace any column (say the k-th one) 

T T 

of A by j ■ so as to form the matrix M. The matrix M M then has 


the form 



T 

MM 


nC 


n - r 



It is not difficult to see that the eigenvalues of m’m are given by 
2 2 2 

{n,n(“-— J-) , (- j-j ) , . . . » " ■'£■) } so that for large n or small e. 


Cond2(M) 


max singular value 
min singular value 



Thus Cond^CM) can be made arbitrarily large by either taking e small or n large. 
Note also that Cond 2 (M) is Independent of which column is selected to contain 
the I's. 

It clearly would be a mistake to use Cond(M) as any sort of gvide to the 
sensitivity the limiting probabilities might exhibit to perturbations in the 
transition probabilities. Aside from the theoretical hazards which the matrix M 
can produce, it is obvious that M could also present numerical difficulties if 
it were used in any sort of computational scheme. 

The bound produced by using M and (7.1) is almost always inferior to the 
bound obtained from Theorem 4.3. As an example, consider again the three state 
chain C, whose transition matrix is given by (6.1). Suppose this chain is 
perturbed so that the transition matrix becomes T ■ T - E where 




Then A ■ A + £. M Is obtained from A by replacing some column of A by j . 
Assume that in M as well as in M, the column which Is J Is taken to be the 
second column. Then 



is the perturbation In M In (7.1). Using the ««norm, one finds that 

Cond <M) > 60,000 whereas <„(C) 15,000. The bound for the relative error in 

u) which (7.1) provides is approximately 1 whereas the bound produced by (4.3) is 

about .6. In this case, the actual relative error (with the <»-norm) is about 

.33334. 

This example exhibits only a single case where (4.3) is superior to (7.1). 

However, experience has shown this to be typical. For each value of n • 3, 5, 

10, 20, and 30, twenty n-state ergodlc chains were randomly generated. A 

random perturbation (which satisfied the hypothesis of Theorem 4.3 and (7.1)) 

was introduced and the bounds given by (4.3) and (7.1) were computed using the 

“-norm. For n ■ 3, (4.3) gave a better bound than (7.1) in 13 out of the 20 

trials. For n ■ 5, (4.3) gave a better bound in 18 out of 20 trials. For each 

of the cases n ■ 10, n « 20, and n ■ 30, (4.3) was found to be superior in 20 

out of 20 trials. Moreover, for each of the 100 chains generated, <„(C) was 

never significantly greater than 5 whereas Cond (M ) was always in the 

“ n>‘n 

2 

neighborhood of n . 



Since the goal was noc to use M in any sort of conputatlonal scheme, but 
rather to determine the degree to which characteristics of M (e.g., Cond(M)) 
relfect the relative sensitivity of the limiting probabilities, no attempt was 
made to scale M. This, of course, could be done and should be done if M is 
specifically given and is to be used in computations. However, when M is not 
specifically given, no theoretical advantage as far as producing a general 
analytical bound on the relative error can be realized. 

ACKIWWLEDCEMENTS. The author wishes to thank Professor Gene Golub for his valuable 
coimsents and suggestions as well as for his hospitality during the author's stay 


at Stanford University. 


REFERENCES 


1. &rovne» Edward T. , Introduction to the Theory of Detemlnants and Matrices , 
The University of North Carolina Press, Chapel Hill, N.C., 1958. 

2. Campbell, S. L., & Meyer, Carl 0., Generalized Inverses of Linear 
Transformations , Pitman Pub, Co., (Surveys and Reference Works in 
Mathematics), 1979, London. 

3. Campbell S. L., & Meyer, Carl D., Continuity Properties of The Orazln 
Pseudoinverse, Linear Algebra And Its Applications, 10(1975), pp, 77-S3. 

4. Gantmacher, F. R. , Matrix Theory . Vol. 2., Chelsea Pub. Co., New York, 1960. 

5. Kememy, J. G. & Snell, J. L. , Finite Markov Chains , D Van Nostrand Co., 

New York, 1960. 

6. Meyer, Carl. 0., The Role Of The Group Generalized Inverse In The Theory 
Of Finite Markov Chains, SIAM Rev., 17(1975), pp. 443-464. 

7. Meyer, Carl D., & Rose, N. J., The Index And The Orazln Inverse Of Block 
Triangular Matrices, SIAM J. Appl. Math., 33(1977), pp. 1-7. 

8. Mirsky, L. , An Introduction to Linear Algebra, Oxford At The Clarendon 
Press, London, 1963. 

9. Schweitzer, Paul J. , Perturbation Theory and Finite Markov Chains, J. 

Appl. Prob., 5(1968), pp. 401-413 

10. Wilkinson, J. H. , The Algebraic Eigenvalue Problem , Oxford University Press, 
London, 1965. 



